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Assessment of the Impact of Individualized Instruction 
on Students— technical report 
Larry J. Malt in 
Project Individualized Instruction 
Suffolk. BOCES 2 

Abstract 

This evaluation study concerns itself with the effect of 
individualized instruction programs on academic achievement and 
attitudes of elementary school children. It was hypothesized that 
students in individualized programs would have significantly higher 
achievement scores and more positive attitudes toward school and 
self 9 and greater self-direction when compared to their peers. The 
effects of I.Q. , sex, and previous levels of achievement were stat- 
istically controlled and the findings were: a) Students in the 
individualized groups had significantly higher scores on measures 
of attitude toward self and school, as well as higher self-direction 
scores, b) Significant differences were not found in achievement 
scores (reading comprehension, math concepts, and math problem 
solving) between the two groups. The sample included 120 fourth 
grade students from programs in the Nassau and Suffolk County 
region of New York. Fifty high school students, initially selected 
for Inclusion, had to be dropped from the study because of 
cancellation of the Math 10 regents. 



Assessment of the Impact of Individualized Instruction 

on Students— technical report 
Larry J. Maltin 
Suffolk, BOCES II 
Background and Rationale 
Project Individualized Instruction (PII)» a three year ESEA 
Title III program, currently in its second year of operaicions, has 
as its major objective **To foster the development of Individualized 
Instruction in the bi-county region of Nassau and Suffolk." The 
project was brought about by the combined efforts of the Long Island 
Regional Individualized Learning Council (LIRILC), the BOCES 
Regional Educational Planning Office (REP), and the four Island 
Boards of Cooperative Educational Services (BOCES). The District 
Superintendents of the four Long Island BOCES supervise and co- 
ordinate project tasks. 

The original project proposal contained two goals. They were: 

1. Locate and evaluate current individualized learning pro- 
grams and practices in Long Island schools, 

2. Collect and diffuse individualized learning methods, skills, 
and techniques, and to identify expertise for the purpose of 
training beginning and practicing teachers and administrators. 

These basic goals have remained the focus of the project. For 
the second year they were expressed as two major product objectives 
— the first relating to the location and evaluation of Indlvidualf- 
Ization practices; the second addressing the collection and diffusion 
of these practices to pre- and in-service educators. 



Within the first objective, two major emphases have existed. 
First, the processes of instruction which exemplify individualization 
have continued to be evaluated. Through refinement of the Individ- 
ualized Instruction Scale and the writing of a self-application 
manual, many educators on Long Island were able to both assess their 
own programs and to be aware of t^ose characteristics which are 
factors of individualized instruction. The second major emphasis 
within this broad objective was a new one. For the first time the 
project staff had assumed the task of assessing the products or 
output of exemplary individualized programs. Enc aragement by the 
State Education Department resulted in what war a major, innovative 
effort — the collection of data regarding the effects of exemplary 
programs on students at the elementary and secondary levels. 

This thrust has been a natural outgrowth of the first year's 
work. With a functioning "process instrument," the I.I. Scale, it 
was now possible to know with some objectivity, which programs are 
good examples of individualization. The next step was to determine 
the effects of these processes on students. Specifically, it was 
being proposed that there would be significantly higher scores for 
students in three elementary and one secondary individualized 
instruction progrsim, when compared to students not involved in 
highly individualized programs in: 

1. Academic Achievement 

2. Self -Direct ion 

3. Attitude Toward Self 

4. Attitude Toward School 

For the purposes of this study, these have been defined as 
follows : 



1. Academic Achievement. Measures of academic achievement 
for the elementary group were reading and mathematics scores obtained 
from the May, 197'! administration of the Iowa Test of Basic Skills. 
?or the secondary school sample, measures of achievement were the 
scores obtained on the June 1974 regents In Euclidian and Coordinate 
Geometry. 

The following three variables have been derived from the Calif- 
ornia Test of Personality and apply to the elementary school sample 
only. A separate scale (P. Attitude Scale) was developed by the 
participating high school for use with Its secondary students. This 
scale Is described more fully In the *' Instruments" section of this 
report.. 

'2. Self-Dlrectlon. Tha concept of self-direct Ion was defined 
as a combination of personal freedom and personal responsibility. A 
student may be said to be self-directed when he believes that he has 
a reasonable share of the determination of his own conduct and that 
he perceives himself to be responsible for the outcomes of his be- 
haviors . 

3. Attitude Toward Self. The concept of attitude toward self 
Is defined so as to Include a sense of personal worth, belonging, 
and sociability. A pupil feels worthy when he believes he Is well 
regarded by others, that others have faith In his future success, 
he has at least average ability. A pupil feels that he belongs 
when he Is accepted by his teachers and classmates, and gets along 
with people In general. A child would normally be regarded as 
sociable when he seeks to get his satisfaction In ways that are not 
damaging and unfair to others. 

Attitude Toward School. The student who has a positive 



attitude toward school is the one who feels that his teachers like 
him, who enjoys being with other students, and who finds the school 
work adapted to his level of interest aAd^aturity. Good attitude 
toward school involves the feeling on the part of the student that 
he "counts for something in the life of the institution." 
Hypotheses 

It was the purpose of this study to address the following: 

1. There will a significant difference in mathematics and 
reading achievement scores between students in the individualized 
instruction program and students in the comparison group, when the 
effects of sex, aptitude (I.Q.), and previous achievement are taken 
into consideration. 

• '2, The dispersion of the achievement scores will be greater 
for students in the individualized instruction program than for 
students in the comparison group. 

3. Measures of self-direction will be higher for students in 
the individualized program than for students in the comparison group. 

1. Measures of attitude toward self will be higher for students 
in the Individualized program than for students in the comparison 
group . 

5. Measures of attitude toward school will be higher for 
students in the individualized program than for students in the 
compariLon group. 

6. Scores of the five dependent variables will be related to 
level of aptitude. 

Method 

Sample 

During the Project's first year of activities, 265 programs 



had been observed in the bl-eounty region. Approximately l60 of 
these programs were elementary and 105 were secondary. Three fourth 
grade programs were selected from this pool to make up the elementary 
sample. Criteria for Inclusion into the study were: 

1. High score on the I.I. Scale, 

2. Placement of students In the Individualized Instruction 
classes was by random assignment, 

3* There was another fourth t ^de In the same school with a 

lower score on the I.I. Scale, 
4. None of the three programs were from the same geographical 

area, 

'5.. School personnel Involved were willing to cooperate In the 
. study. 

Selection of the appropriate secondary program proved to be an 
extremely difficult task. In situations where there was a highly 
Individualized program, there were no oth«r classes In the same 
subject area that could serve as a comparison group. Finally, a 
pilot Individualized mathematics program was located which met uhe 
above criteria. This program was Included In the study. 
Procedure 

Once the Individualized Instruction and the comparison groups 
were Identified, meetings were held with the teachers and principals 
to discuss the purpose of the study, the use to which the findings 
were to be puM, and their responsibilities relative to the study. 

The elementary teachers waived the option of administering the 
Instruments themselves, and requested that the PII staff give all 
the tests. The students were told that their responses to the 
attitude scales would remain strictly confidential, and so the 



teachers were asked to leave the room during administration. 

The secondary students were administered their attitude scales 
by their teachers » but they were not required to put their names on 
the response sheet. The Math 10 regents was scheduled for June 17 > 
however Just prior to that date the examination was cancelled by 
order of the Commissioner of Education. There was insufficient 
time remaining before the students recessed for summer vacation to 
develop another appropriate criterion measure for this sample to be 
included in the present study. 
Instruments 

The following are descriptions of the instruments used to 
obtain -data for this study: 

•The Individualized Instruction Scale (I.I. Scale). This'scale, 
developed by PII, represents a major attempt to quantify individual- 
ized instruction. It examines two processes, monitoring and deci- 
sion making, which facilitate the assignment of instructional strat- 
egies. Validity for the items used was sought in terms of agreement 
with a formal definition c.^ individualized instruction. A Jury of 
educators from Nassau and Suffolk Counties rated each item relative 
to this definition. The instrument used in the current study was a 
revised form of the original scale. 

The Affective Triad Scale (ATS). The ATS was developed by the 
PII staff specifically to meet the requriements of the present study. 
It was designed for use with elementary school chilciren approximately 
nine years of age. Teachers from Nassau and Suffolk Counties met to 
develop the basic pool of items from which the scale was derived. 
The preliminary instrument was piloted and then subjected to an 
analysis to determine each item's power to discriminate in each of 



the three categories. 

Lorge-Thorndlke Intelligence Test, level 3, form A. Both the 
verbal and non-verbal tests were administered to those elementary 
students for whom a recent aptitude score was unavailable. 

Iowa Test of Basic Skills (ITBS), form 5, level 10. The ITBS 
was used as the criterion measure for determining differences in 
academic achievement between the two groups of elementary students. 

Pupil Evaluation Program (PEP). Scores obtained during the 
previous year's administration of the PEP provided "base-line" 
scores for the two groups of elementary students. 

New York State Hath 10 regents in Euclidian and Coordinate 
Qeometry. The Math 10 regents was used as the criterion measure for 
determining differences in achievement between the two groups of 
secondary students. 

Differential Aptitude Test (DAT). The DAT scores provided 
"base-line" data for the two groups of secondary students. 

P. Attitude Scale (PAS). The PAS was a district developer" 
attitude scale used with the secondary level students to measure 
differences in attitudes between the two groups. This scale was 
derived from concepts and items appearing on the Instructional 
Objectives Exchange (lOX) School Sentiment Index. 

Data Analysis 

One objective of experimental design is to ensure that the 
results observed may be attributed, within limits of error, to the 
treatment variable and to no other causal circumstance. Usually 
experlmsntal controls, such as random assignment and matching, are 
used to ensure freedom from bias. In the present study, because 
of practical limitations associated with the school setting, a 



otatlstlcal, rather than an experimental, method was used to 
"control" the effects of the uncontrollsd variables. The Multi- 
variate Analysis of Variance (MANOVA) was selected as being the 
appropriate procedure. 

MANOVA deals with data collected on several dimensions of the 
same individual. The mathematical model on which the analysis is 
based is a multivariate normal distribution or a combination of 
multivariate normal distributions. One clear advantage of this 
procedure is that it provides more than one criterion by which to 
measure the effects of the two programs. 

In this application the influence of the covariates— sex, 
intelligence, an.1 previous levels of achievement in reading and 
math-'-were removed using a canonical regression method, and the 
residual sums of squares used to provide variance estimates which 
in turn were used to make tests of significance for each of the six 
dependent variables, or criteria. 

Results 

The following results were obtained following analysis of the 
data obtained from the two groups: 

1. The test of significance, using Wilks Lambda criterion, 
indicated that when the effects of sex, I. Q. , prior achievemont in 
math and reading were taken into account, there was a significant 
overall difference between the two groups (p less than .001; see 
Appendix, p. 5)* 

Comparisons of scores for the two groups based upon estimates 
adjusted for the five covariates indicated the following: 

a) the comparison group had an adjusted score difference 
of 1.158 points higher than the individualized group in reading 



comprehension (Appendix, p. 3)* 

b) the Individualized group had higher adjusted scores than 
the comparison group In all other criterion measures. The differences 
between the two groups ranged from .007 to 2.128 points (Appendix, p. 3) 

2. Univariate F tests for each dependent variable, eliminating 
the effects of the five covarlates (Appendix, p. 5)» indicated that 
att* de toward school, and self-direction were significantly higher 
for the individualized group than for the comparison group (p less 
than .001). Attitude toward self was more positive for the individ- 
ualized group than for the comparison group (p less than .055). A 
difference of that magnitude could be attributed to chance occurrence 
not more than fifty-five times in a thousand. Random fluctuations 
could account for differences in the following scores: 

a) reading comprehension (p less than .146) 

b) math problem solving (p less than .416) 

c) math concepts (p less than .989) 

3. Ihere was no significant difference in the dispersion of 
achievement scores between the two groups. 

4. Approximately 25% of the variance in the scores could be 
explained by I. Q. (Appendix, p. 10). 

Discussion 

This study attempted to explore the relationship between two methods 
of instruction, academic achievement, and student attitude changes. 
The hypothesized relationships between individualized instruction 
and tlie dependent variables were only partially confirmed. 

The reasons that a significant relationship between individual- 
ized instruction and high achievement did not materialize are not 
entirely clear. Among some of the reasons that might be offered to 



possibly account for the similarity In achievement test scores of 
the two groups, are the following: 

1. One school year was an Insufficient length of time for 
exposure to Individualized Instruction. 

2. Some Individualized Instruction methodology was carried 
across the hall** and used by the teachers of the comparison groups 
and thus the actual methodological differences were not as great as 
originally Indicated. 

3. Test-wlseness. 

To elaborate on the first point » one might speculate first of 
all as to whether It was not an over optimistic act of faith to have 
expected any kind of brief Intervention to produce an Immediate 
effect on achievement scores. Perhaps these Intervenlent procedures 
and their effects would take a much longer period of time than eight 
months, to be manifested. The logic of this may be derived from the 
following line of reasoning. It Is possible that achievement Is not 
yet so vital a matter for those nine year olds who are In a high 
Individualized Instruction setting. There students are finding 
themselves In a novel situation where success opportunities are 
maximized and ''there Is no failure." Contrast this to the students 
In the comparison group who are confronted with the reality of 
encountering "failure." What Is suggested here Is that, for 
students In the comparison group, there may be much greater ego* 
Involvement with experienced academic successes and failures. 
This occurs when the students perceive In "very real terms" how 
their own performance relates to those of their peers. In contrast 
to this, for students In the highly Individualized group, the 
consequences of success or failure are more personal and thus less 



subject to social exposure and "public humiliation.** Therefore » 
when a child Is In a highly Individualized program, a much more 
highly crystallzed academic achievement performance attitude might 
not occur until later In his school career. 

The other explanation that seems to require further elabora- 
tion Is the third, pertaining to test-wlseness. One component of 
test-wlseness generally acknowledged as having an effect on test 
performance Is time utilization. Teacher concern In the classroom 
Is customarily Involved with Improving achievement by emphasizing 
instruction in subject matter. It may be of value to teach the 
appropriate use of resources other than subject matter resources 
that ar« relevant to performance. 

>A second component of test-wlseness would be familiarity with 
the testing conditions in general. Both groups were evaluated on a 
standardized achievement test in a standard test seating. In retro- 
spect, it does seem plausible to consider this condition to have 
created for the individualized student a very alien working condition, 
quite unlike the one to which he was accustomed in his classroom 
where testing was more "personal," questions could always be asked, 
and generally no specific time limits are imposed. Improved scores, 
the result of Instuction in test taking, would not reflect improved 
achievement, but would at least reduce the error of mistaking as low 
achievement that which is partially something else. 

Another, less subtle, effect on the achievement, scores may have 
been present because the students in the high individualized group 
actually may not have been taught some of the content included in 
the standardized tests. This did not result from any teachers* 
failure to teach properly, but rather as an artifact of the method 
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itself. Teachers In the high Individualized settings have greater 
opportunity to deal with each student's areas of deficiencies, no 
matter how much **class time** Is needed* Some of the school year, 
undoubtedly, had been utilized In this manner, and these students 
are penalized, therefore, by having less opportunity to learn the 
subject matter In which they were subsequently evaluated. The fact 
that they did at least as well as their peers In the comparison 
group, would seem to suggest that Individualized Instruction, within 
the limitations of this study, might be worthy of further examination. 

It should be emphasized that the stability of these findings 
may be questioned due to the small number of students tested, but 
these results may well offer some suggestions as to the direction 
of. future research. 

Finally, the discussion would be incomplete without reference 
to an extremely important llmiation of these results. Extreme 
caution should be exercised in generalizing from these results since 
the three groups may not necessarily represent a true sample of 
elementary school programs. The effectiveness of the procedure, 
both in terms of differences in achievement scores and affective 
measures, remain to be assessed in a larger sample of students. 
Similarly, the effect iver*iss of individualized instruction as de- 
termined in this study, applies only to the specific stduents, the 
specific schools, and other specific aspects of the total situation. 

Conclusions 

The following statements are offered in conclusion regarding 
the effects of individualized instruction on students and within the 
limitations imposed by the specifics of this study: 

1. Students in individualized Instruction programs do as well 



as their peers In the comparison groups In reading comprehension » 
math concepts and math problem solving. 

2. There does not appear to be any significant difference 
between the two groups In the dispersion of achievement scores. 

3* Students In Individualized Instruction programs have a 
significantly more positive sense of self-direction than their peers 
In the comparison groups. 

'I. Students in individualized instruction programs have a 
considerably more positive self-attitude than their peers. Although 
this difference failed to achieve statistical significance at the 
customary level of acceptance » a difference of the observed magnitude 
(p less- than .035) is great enough to warrant further serious 
consideration. 

5. Students in individualized instruction programs have a 
significantly more positive attitude toward school than their peers 
in the comparison groups. 

6. Twenty-five percent of the observed variance between the 
groups can be accounted for by partlalllng out the effect of 
intelligence. 

In a more general sense, one may conclude from this study that 
although the differences in achievement between both groups was not 
statistically significant, the differences in attitudes, particularly 
as relating to school, were significant. This may well be the 
critical point, for attitudes toward school are very Important in 
the very human sense that it is better to be satisfied than discontent 
doing what one must do anyway. 
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